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Abstract 

Recent advances in convex optimization have led to new strides in the phase retrieval problem over finite-dimensional 
vector spaces. However, certain fundamental questions remain: What sorts of measurement vectors uniquely determine 
every signal up to a global phase factor, and how many are needed to do so? Furthermore, which measurement 
ensembles lend stability? This paper presents several results that address each of these questions. We begin by 
characterizing injectivity, and we identify that the complement property is indeed a necessary condition in the complex 
case. We then pose a conjecture that AM - 4 generic measurement vectors are both necessary and sufficient for 
injectivity in M dimensions, and we prove this conjecture in the special cases where M = 2,3. Next, we shift our 
attention to stability, both in the worst and average cases. Here, we characterize worst-case stability in the real case 
by introducing a numerical version of the complement property. This new property bears some resemblance to the 
restricted isometry property of compressed sensing and can be used to derive a sharp lower Lipschitz bound on the 
intensity measurement mapping. Localized frames are shown to lack this property (suggesting instability), whereas 
Gaussian random measurements are shown to satisfy this property with high probability. We conclude by presenting 
results that use a stochastic noise model in both the real and complex cases, and we leverage Cramer-Rao lower bounds 
to identify stability with stronger versions of the injectivity characterizations. 
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1. Introduction 

Signals are often passed through linear systems, and in some applications, only the pointwise absolute value of the 
output is available for analysis. For example, in high-power coherent diffractive imaging, this loss of phase information 
is eminent, as one only has access to the power spectrum of the desired signal ]9|]. Phase retrieval is the problem 
of recovering a signal from absolute values (squared) of linear measurements, called intensity measurements. Note 
that phase retrieval is often impossible — intensity measurements with the identity basis effectively discard the phase 
information of the signal's entries, and so this measurement process is not at all injective; the power spectrum similarly 
discards the phases of Fourier coefficients. This fact has led many researchers to invoke a priori knowledge of the 
desired signal, since intensity measurements might be injective when restricted to a smaller signal class. Unfortunately, 
this route has yet to produce practical phase retrieval guarantees, and practitioners currently resort to various ad hoc 
methods that often fail to work. 

Thankfully, there is an alternative approach to phase retrieval, as introduced in 2006 by Balan, Casazza and 
Edidin Q7(] : Seek injectivity, not by finding a smaller signal class, but rather by designing a larger ensemble of intensity 
measurements. In I7J, Balan et al. characterized injectivity in the real case and further leveraged algebraic geometry to 
show that AM - 2 intensity measurements suffice for injectivity over M-dimensional complex signals. This realization 
that so few measurements can lend in j ectivit y has since prompted a flurry of research in search of practical phase 



retrieval guarantees L3J, [14J, |18l |19l |37|] . Notably, Candes, Strohmer and Voroninski [14J viewed intensity 



measurements as Hilbert-Schmidt inner products between rank-1 operators, and they applied certain intuition from 
compressed sensing to stably reconstruct the desired M-dimensional signal with semidefinite programming using only 



0(M log M) random measurements; similar alternatives and refinements have since been identified 012lll3l Il8l 13711 . 
Another alternative exploits the polarization identity to discern relative phases between certain intensity measure- 
ments; this method uses 0(M log M) random measurements in concert an expander graph, and comes with a similar 
stability guarantee J2l ■ 
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Despite these recent strides in phase retrieval algorithms, there remains a fundamental lack of understanding about 
what it takes for intensity measurements to be injective, let alone whether measurements lend stability (a more nu- 
merical notion of injectivity). For example, until very recently, it was believed that 3M - 2 intensity measurements 
sufficed for injectivity (see for example il2"ll ); this was disproved by Heinosaari, Mazzarella and Wolf ll24ll . who used 
embedding theorems from differential geometry to establish the necessity of (4 + o(l))M measurements. As far as 
stability is concerned, the most noteworthy achievement to date is due to Eldar and Mendelson lfl9ll . who proved that 
O(M) Gaussian random measurements separate distant M-dimensional real signals with high probability. Still, the 
following problem remains wide open: 

Problem 1. What are the necessary and sufficient conditions for measurement vectors to lend injective and stable 
intensity measurements? 

The present paper addresses this problem in a number of ways. Section 2 focuses on injectivity, and it starts by 
providing the first known characterization of injectivity in the complex case (Theorem |4]i. Next, we make a rather 
surprising identification: that intensity measurements are injective in the complex case precisely when the correspond- 
ing phase-only measurements are injective in some sense (Theorem 0. We then use this identification to prove the 
necessity of the complement property for injectivity (Theorem|7]i. Later, we conjecture that AM - 4 intensity measure- 
ments are necessary and sufficient for injectivity in the complex case, and we prove this conjecture in the cases where 
M — 2, 3 (Theorems 1 1 01 and [T2l . Our proof for the M — 3 case leverages a new test for injectivity, which we then use 
to verify the injectivity of a certain quantum-mechanics-inspired measurement ensemble, thereby suggesting a new 
refinement of Wright's conjecture from ll36ll (see Conjecture Q73J. 

We devote Section 3 to stability. Here, we start by focusing on the real case, for which we give upper and lower 
Lipschitz bounds of the intensity measurement mapping in terms of singular values of submatrices of the measurement 
ensemble (Lemma[T6land Theorem[T8li: this suggests a new matrix condition called the strong complement property, 
which strengthens the complem ent p roperty of Balan et al. [7] and bears some resemblance to the restricted isometry 
property of compressed sensing IU1]. As we will discuss, our result corroborates the intuition that localized frames fail 
to lend stability. We then show that Gaussian random measurements satisfy the strong complement property with high 
probability (Theorem l20l, which nicely complements the results of Eldar and Mendelson lfl9ll . In particular, we find 
an explicit, intuitive relation between the Lipschitz bounds and the number of intensity measurements per dimension 
(see Figure [37X1 Finally, we present results in both the real and complex cases using a stochastic noise model, much 
like Balan did for the real case in fl; here, we leverage Cramer-Rao lower bounds to identify stability with stronger 
versions of the injectivity characterizations (see Theore ms |2TI and l23l . 

1.1. Notation 

Given a collection of measurement vectors O = {tp n }^ =l in V — M. M or C M , consider the intensity measurement 
process defined by 

Wx))(n) :=\(x,<p n )\ 2 . 

Note that J[(x) = 3l{y) whenever y = cx for some scalar c of unit modulus. As such, the mapping M: V — » R N is 
necessarily not injective. To resolve this (technical) issue, throughout this paper, we consider sets of the form V/S , 
where V is a vector space and S is a multiplicative subgroup of the field of scalars. By this notation, we mean to 
identify vectors x, y e V for which there exists a scalar c e S such that y = cx; we write y = x mod S to convey this 
identification. Most (but not all) of the time, V/S is either M M /{±1) or C M /T (here, T is the complex unit circle), and 
we view the intensity measurement process as a mapping JH: V/S — » M. N ; it is in this way that we will consider the 
measurement process to be injective or stable. 

2. Injectivity 

2.1. Injectivity and the complement property 

Phase retrieval is impossible without injective intensity measurements. In their seminal work on phase retrieval [Q], 
Balan, Casazza and Edidin introduce the following property to analyze injectivity: 

Definition 2. We say O = {ip„}„ =1 in R M (C M ) satisfies the complement property (CP) if for every S C {1, . . ., N], 
either {<p„} ne s or \ip n } neS c spans R M (C M ). 
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In the real case, the complement property is characteristic of injectivity, as demonstrated in 0]. We provide the 
proof of this result below; it contains several key insights which we will apply throughout this paper. 

Theorem 3. Consider <D = {^„}^ =1 Q M. M and the mapping ^R: R M /{±1) -> R N defined by (M(xj)(ri) := \(x,(p n )\ 2 . 
Then J{ is infective if and only if$> satisfies the complement property. 

Proof. We will prove both directions by obtaining the contrapositives. 

(=>) Assume that <t> is not CP. Then there exists S Q {1,.,.,N} such that neither \ip„} n es nor {(p„}, ie s c spans R M . 
This implies that there are nonzero vectors u, v e M. M such that (u, <p„) = for all n e S and (v, <p n ) = for all n e S c . 
For each n, we then have 



|<m ± v, <p n )\ z = |<m, ip n )\ l + 2 Re<M, <p n )(v, <p n ) + |(v, <p n )\ z = \{u, <p n )\ z + |(v, ip„)\ z . 

Since |(m + v, (p„)\ 2 = |(m - v, <^„)| 2 for every «, we have J[{u + v) = 3l{u - v). Moreover, u and v are nonzero by 
assumption, and so u + v + +(u - v). 

(<=) Assume that J[ is not injective. Then there exist vectors x,y € R M such that x + ±y and J\.(x) = Jl(y). Taking 
S : = \n : (x, <p H ) = -(y, <p n )}, we have (x+y, tp„) = for every n e S . Otherwise when n € S c , we have (x, tp„) = (y, <p n ) 
and so (x-y,<p n ) = 0. Furthermore, both x + y and x-y are nontrivial since jc # ±y, and so neither {^„} ne s nor{y!„}„ eS c 
spans M M . □ 

Note that J3l erroneously stated that the first part of the above proof also gives that CP is necessary for injectivity 
in the complex case; the reader is encouraged to spot the logical error. We wait to identify the error later in this section 
so as to avoid spoilers. We will also give a correct proof of the result in question. In the meantime, let's characterize 
injectivity in the complex case: 

Theorem 4. Consider O = {<p n }* =1 £ C M and the mapping ft: C M /T -> R N defined by {&.{x)){ri) := \{x,tp n )\ 2 . 
Viewing {<p„(p*u}^ =l as vectors in M. 2M , denote S(u) :— span R {^„^*w}^ =1 . Then the following are equivalent: 

(a) 3\. is injective. 

(b) dimS(M) > 2M - I for every u € C M \ {0}. 

(c) S(u) = spanjjfiM}" 1 - for every u € C M \ {0}. 

Before proving this theorem, note that unlike the characterization in the real case, it is not clear whether this charac- 
terization can be tested in finite time; instead of being a statement about all (finitely many) partitions of {1, . . . , iV}, this 
is a statement about all u e C M \ {0}. However, we can view this characterization as an analog to the real case in some 
sense: In the real case, the complement property is equivalent to having spanl^n^Mj^j = M. M for all u e M. M \ {0}. 
As the following proof makes precise, the fact that {ip„(p*u}^ =l fails to span all of R 2M is rooted in the fact that more 
information is lost with phase in the complex case. 

Proof of Theorem\4\ (a) => (c): Suppose J[ is injective. We need to show that \<p„<jf n u}^ =x spans the set of vectors 
orthogonal to iM. Here, orthogonality is with respect to the real inner product, which can be expressed as {a, b)g. = 
Re<a, b). Note that 

|<m ± v, (p„}\ 2 = |<m, <p„}\ 2 + 2 Re(u, (p„)((p„, v> + |(v, <p n }\ 2 , 

and so subtraction gives 

|<m + v,<p„}\ 2 - |(m - v,ip„)\ 2 = 4Re(u,<p n )(<p n , v) = 4{(p n (p* n u, v)]r. (1) 

In particular, if the right-hand side of ([TJ is zero, then injectivity implies that there exists some to of unit modulus such 
that u + v = u)(u - v). Since u + 0, we know a> + -1, and so rearranging gives 

1 - a) 2Imw 

V = M = -z M = -r IM. 

1 + a) |1 + u>\ 2 |1 + a>\ 2 

This means S(u) x Q span R {iM). To prove span R {iM) c S(u)- 1 -, take v = aiM for some a e R and define to :- which 
necessarily has unit modulus. Then 

1 + ffi 

m + v = m + am — (1 + a\)u = -{u - aiu) = cj{u - v). 

1 - on 
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Thus, the left-hand side of (Q]) is zero, meaning v e 5 , (w) J ". 

(b) <=> (c): First, (b) immediately follows from (c). For the other direction, note that \u is necessarily orthogonal to 
every <p„<p* n u: 

<</)„</>>, iw) R = Re(^„^*M,iM> = Re(t(, <p n )(<p n , iu) = -Rei\(u,(p„}\ 2 = 0. 

Thus, span R {ii<} c ^(m)^, and by (b), dimS^O^ < 1, both of which gives (c). 

(c) => (a): This portion of the proof is inspired by Mukherjee's analysis in l33ll . Suppose J{(x) = Ji(y). If x — y, 
we are done. Otherwise, x - y + 0, and so we may apply (c) to u = x - y. First, note that 

(<p n (p* n (x - y), x + y) m = Re(<p n (p* n (x - y),x + y) = Re(x + y)*<p n <p*(x - y), 

and so expanding gives 

(<Pn<P* n (x -y),x + y> K = Re (\ip*„x\ 2 - x*ip„ip* t y + y*<p n <p* n x - \ip*y\ 2 ) = Re ( - x*<p„<p' n y + x*<p„<p*y) = 0. 

Since x + y e S(x - y) 1 - = span R {i(x - y)}, there exists net such that x + y — ai(x - y), and so rearranging gives 
y - j^x, meaning y = x mod T. □ 

The above theorem leaves a lot to be desired; it is still unclear what it takes for a complex ensemble to yield 
injective intensity measurements. While in pursuit of a more clear understanding, we established the following bizarre 
characterization: A complex ensemble lends injective intensity measurements precisely when it lends injective phase- 
only measurements (in some sense). This is made more precise in the following theorem statement: 

Theorem 5. Consider <£ = [<p n }% =1 Q C M and the mapping jfl: C M /T -> R N defined by (tt(x))(ri) := \{x, ip„)\ 2 . Then 
J[ is injective if and only if the following statement holds: If for every n = \, . . . ,N, either arg((x, (fi„) 2 ) — arg((y, <p„) 2 ) 
or one of the sides is not well-defined, then x — 0, y — 0, or y = x mod K \ {0}. 

Proof. By Theorem|4] J[ is injective if and only if 

VxeC M \{0}, span R {^^jc}^ =1 = span K {i4 x Vn = l,...,N. (2) 

Taking orthogonal complements of both sides, note that regardless of x € C M \ {0}, we know span R {ix) is necessarily 
a subset of (span R {(/?„(/?*x}^ =1 )- L , and so <J2J is equivalent to 

VxeC M \{0}, Re((p„(p*„x, iy) = Vn=l,...,N ^> y = ory s x mod K \ {0}. 



Thus, we need to determine when Jm{x, ip„)(y, ip n ) = Re{tp„<p*x,iy) = 0. We claim that this is true if and only 
if arg((x, tp„) 2 ) = nig((y,(p„) 2 ) or one of the sides is not well-defined. To see this, we substitute a := (x,<p„) and 
b := (y, (p n ). Then to complete the proof, it suffices to show that Imab = if and only if arg(a 2 ) = arg(b 2 ), a — 0, or 
b = 0. 

(<=) If either a or b is zero, the result is immediate. Otherwise, if 2 arg(a) = arg(a 2 ) = arg(/? 2 ) = 2 arg(b), then 
2n divides 2(arg(a) - arg(fr)), and so aig(ab) = arg(a) - arg(fe) is a multiple of ji. This implies that ab 6 R, and so 
Im ab - 0. 

(=>) Suppose Imab = 0. Taking the polar decompositions a — re lB and b = se^, we equivalently have that 
rssin(6- <f>) = 0. Certainly, this can occur whenever r or s is zero, i.e., a — or b — 0. Otherwise, a difference 
formula then gives sin 9 cos <p = cos 8 sin (p. From this, we know that if 9 is an integer multiple of n/2, then tp is as well, 
and vice versa, in which case arg(a 2 ) = 2 arg(a) = n — 2 arg(b) = arg(Z? 2 ). Else, we can divide both sides by cos 9 cos <p 
to obtain tan 8 = tan <p, from which it is evident that 8 = (f> mod n, and so arg(a 2 ) = 2 arg(a) = 2 arg(b) = arg(Z? 2 ). □ 

To be clear, it is unknown to the authors whether such phase-only measurements arrive in any application (nor 
whether a corresponding reconstruction algorithm is feasible), but we find it rather striking that injectivity in this 
setting is equivalent to injectivity in ours. We will actually use this result to (correctly) prove the necessity of CP for 
injectivity. First, we need the following lemma, which is interesting in its own right: 

Lemma 6. Consider <D = Wn)^ =x £ C M and the mapping M: C M /T -> R N defined by (M(x))(n) := \{x, ip„)\ 2 . Iftf. is 
injective, then the mapping £ : C M / {+ 1 } — > C N defined by {!B{x))(n) := (x, tp n ) 2 is also injective. 

Proof. Suppose M is injective. Then we have the following facts (one by definition, and the other by Theorem|5]i: 
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(i) If Vn = l,...,N, |<jc, ^„>| 2 = \<y,<p„)\ 2 , theny = x mod T. 

(ii) If V« = 1, . . . , N, either arg((jic, ip„} 2 ) = arg((y, (p„) 2 ) or one of the sides is not well-defined, then x = 0, y — 0, or 
y = x mod ffi \ {0}. 

Now suppose we have (x,<p n ) 2 = (y,<p„) 2 for all n = 1, . . . ,N. Then their moduli and arguments are also equal, and 
so (i) and (ii) both apply. Of course, y = x mod T implies x = if and only if y = 0. Otherwise both are nonzero, in 
which case there exists weTnR\{0) = j+l) such that y = a>x. In either case, y = x mod {± 1 }, so £ is injective. □ 

Theorem 7. Consider O = {^„}^ =I £ C M anc/ f/ie mapping M: C M /T -> R w denned by (M(x))(n) := |<jc, y n >| 2 . //^ 
is injective, then <I> satisfies the complement property. 

Before giving the proof, let's first divulge why the first part of the proof of Theorem|3]does not suffice: It demon- 
strates that u + v + ±(u - v), but fails to establish that u+v^u-v mod T; for instance, it could very well be the case 
that u + v = i(u - v), and so injectivity would not be violated in the complex case. Regardless, the following proof, 
which leverages the injectivity of £ modulo {+1}, resolves this issue. 

Proof of Theorem\7\ Recall that if J[ is injective, then so is the mapping £ of Lemma[6] Therefore, it suffices to show 
that <1> is CP if £ is injective. To complete the proof, we will obtain the contrapositive (note the similarity to the proof 
of Theorem|3]l. Suppose O is not CR Then there exists S Q {l,.,.,N} such that neither {<p n }„es nor {tfi n } n es c spans <C M . 
This implies that there are nonzero vectors u, v e C M such that (u, tp n ) = for all « e S and (v, <p n ) = for all « e S c . 
For each «, we then have 

(u ± v, tp„) 2 = (u, ip„) 2 + 2(u, <p n )(v, <p n ) + <v, tp„) 2 = (u, ip„) 2 + (v, tf„) 2 . 

Since (u+v, tp n ) 2 = (u-v, (p„) 2 for every n, we have £(u + v) = £(u-v). Moreover, u and v are nonzero by assumption, 
and so u + v + +(u - v). □ 

Note that the complement property is necessary but not sufficient for injectivity. To see this, consider measurement 
vectors (1,0), (0, 1) and (1, 1). These certainly satisfy the complement property, but J?l((l,i)) = (1, 1,2) = J?l((l, -i)), 
despite the fact that (l,i) £ (1,-i) mod T; in general, real measurement vectors fail to lend injective intensity mea- 
surements in the complex setting since they do not distinguish complex conjugates. Indeed, we have yet to find a 
"good" sufficient condition for injectivity in the complex case. As an analogy for what we really want, consider the 
notion of full spark: An ensemble {tp n }^ =l £ K M is said to be full spark if every subcollection of M vectors spans 
M. M . It is easy to see that full spark ensembles with > 2M - 1 necessarily satisfy the complement property (thereby 
implying injectivity in the real case), and furthermore, the notion of full spark is simple enough to admit deterministic 
constructions JUSl- Deterministic measurement ensembles are particularly desirable for the complex case, and so 
finding a good sufficient condition for injectivity is an important problem that remains open. 

2.2. Towards a rank-nullity theorem for phase retrieval 

If you think of a matrix (E> as being built one column at a time, then the rank-nullity theorem states that each column 
contributes to either the column space or the null space. If the columns are then used as linear measurement vectors 
(say we take measurements y = <D*x of a vector x), then the column space of <t> gives the subspace that is actually 
sampled, and the null space captures the algebraic nature of the measurements' redundancy. Therefore, an efficient 
sampling of an entire vector space would apply a matrix <t> with a small null space and large column space (e.g., an 
invertible square matrix). How do we find such a sampling with intensity measurements? The following makes this 
question more precise: 

Problem 8. For any dimension M, what is the smallest number N*(M) of injective intensity measurements, and how 
do we design such measurement vectors? 

To be clear, this problem was completely solved in the real case by Balan, Casazza and Edidin Indeed, 
Theorem|3]immediately implies that 2M-2 intensity measurements are necessarily not injective, and furthermore that 
2M — 1 measurements are injective if and only if the measurement vectors are full spark. As such, we will focus our 
attention to the complex case. 



In the complex case, Problem[8]has some history in the quantum mechanics literature. For example, II36II presents 



Wright's conjecture that three observables suffice to uniquely determine any pure state. In phase retrieval parlance, the 



5 



conjecture states that there exist unitary matrices U\, U 2 and t/3 such that O = [U\ U 2 U3] lends injective intensity 
measurements (here, the measurement vectors are the columns of <t>). Note that Wright's conjecture actually implies 
that N*{M) < 3M - 2; indeed, U\ determines the norm (squared) of the signal, rendering the last column of both U 2 
and C/3 unnecessary. Finkelstein I22I1 later proved that N*(M) > 3M - 2; combined with Wright's conjecture, this 



led many to believe that N*(M) = 3M - 2 (for example, see IU2I0 . However, both this and Wright's conjecture were 



recently disproved in 024I1 . in which Heinosaari, Mazzarella and Wolf invoked embedding theorems from differential 
geometry to prove that 

f AM - 2a(M - 1) - 3 for all M 
N*(M) > I 4M-2a(M- l)-2 if M is odd and a(M - 1) = 2 mod 4 (3) 
{ 4M - 2a(M - 1) - 1 if M is odd and a(M - 1) = 3 mod 4, 

where a(M — 1) < log 2 (M) is the number of 1 's in the binary representation of M — 1 . By comparison, Balan, Casazza 
and Edidin fl] proved that N*(M) < AM - 2, and so we at least have the asymptotic expression N*(_M) = (4 + o(l))M. 

At this point, we should clarify some intuition for N*(M) by explaining the nature of these best known lower 
and upper bounds. First, the lower bound ((3) follows from an older result that complex projective space CP" does 
not smoothly embed into R 4 "- 2q <") (and other slight refinements which depend on «); this is due to Mayer 13 ill , but 



we highly recommend James's survey on the topic |26|]. To prove (O from this, suppose JH: C M /T — > W N were 
injective. Then & defined by S(x) :- Jl(x)/\\x\\ 2 embeds CP M ~' into M. N , and as Heinosaari et al. show, the embedding 
is necessarily smooth; considering J\.(x) is made up of rather simple polynomials, the fact that <5 is smooth should not 
come as a surprise. As such, the nonembedding result produces the best known lower bound. To evaluate this bound, 



first note that Milgram B2I1 constructs an embedding of CP" into jj 4 "- q, (")+ 1 i establishing the importance of the a(n) 
term, but the constructed embedding does not correspond to an intensity measurement process. In order to relate these 
embedding results to our problem, consider the real case: It is known that for odd n > 7, real projective space MP" 



smoothly embeds into M? n - a{n)+l 135|], which means the analogous lower bound for the real case would necessarily be 
smaller than 2{M - 1) - a(M - 1) + 1 = 2M - a(M - 1) - 1 < 2M - 1. This indicates that the a(M - 1) term in (0 
might be an artifact of the proof technique, rather than of N*(M). 

There is also some intuition to be gained from the upper bound N*(M) < AM - 2, which Balan et al. proved by 
applying certain techniques from algebraic geometry (some of which we will apply later in this section). In fact, their 
result actually gives that AM - 2 or more measurement vectors, if chosen generically, will lend injective intensity 
measurements; here, generic is a technical term involving the Zariski topology, but it can be thought of as some undis- 
closed property which is satisfied with probability 1 by measurement vectors drawn from continuous distributions. 
This leads us to think that N*(M) generic measurement vectors might also lend injectivity. 

The lemma that follows will help to refine our intuition for N*(M), and it will also play a key role in the main 
theorems of this section (a similar result appears in |]24j). Before stating the result, define the real M 2 -dimensional 



space H MxM of self-adjoint M x M matrices; note that this is not a vector space over the complex numbers since the 
diagonal of a self-adjoint matrix must be real. Given an ensemble of measurement vectors {y? n }^ =1 £ C M , define the 
super analysis operator A : H MxM — > R" by (AH)(n) = (H, <p„(p*)m', here, (•, -)hs denotes the Hilbert-Schmidt inner 
product, which induces the Frobenius matrix norm. Note that A is a linear operator, and yet 

(Axx*)(n) = (xx*, <p n <P*n)as = Tr[i^*xx*] = Tr[ip* n xx* ip n ] = <p*xx*<p n = \(x,ip„)\ 2 = (J{(x)){n). 

In words, x mod T can be "lifted" to xx*, thereby linearizing the intensity measurement process at the price of squaring 
the dimension of the vector space of interest; this identification has been exploited by some of the most noteworthy 
strides in modern phase retrieval ||6 14 1. As the following lemma shows, this identification can also be used to 



characterize injectivity: 

Lemma 9. J{ is not injective if and only if there exists a matrix of rank I or 2 in the null space of A.. 

Proof. (=>) If J[ is not injective, then there exist x,y e C M /T such that J[(x) = ^l(y). That is, Axx* = Ayy*, and so 
xx* - yy* is in the null space of A. 

(<=) First, suppose there is a rank-1 matrix H in the null space of A. Then there exists x e C M such that H = xx* 
and (Jl(x))(n) = (Axx*)(n) — = (^[(0))(n). But x S mod T, and so J[ is not injective. Now suppose there is a 
rank-2 matrix H in the null space of A. Then by the spectral theorem, there are orthonormal u\, Ui e C M and nonzero 
A\ > A2 such that H = Aiuiu* + AoMiU^. Since H is in the null space of A, the following holds for every n: 

= (H,<p n <p* n )us = (A\U\u\ + A 2 u 2 ul, (p n ip* n )m = MVMi,<p n )? + A 2 \(u 2 , f„}\ 2 . (4) 
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Taking x :- \A\\ ' u\ and y := I/I2I ' «2> n °te thaty £ x mod T since they are nonzero and orthogonal. We claim that 
ft(x) = ft(y), which would complete the proof. If A\ and A2 have the same sign, then by @, \{x, (/?„}| 2 + \(y, ip„)\ 2 = 
for every n, meaning \(x, ip„)\ 2 = = |(y, <^„)[ 2 . Otherwise, /l; > > /I2, and so xx* - yy* = A\U\u\ + A2U2U2 = A is in 
the null space of A, meaning ft(x) = Axx* - Ayy* - ft(y). □ 

Lemma |9] indicates that we want the null space of A to avoid nonzero matrices of rank < 2. Intuitively, this is 
easier when the "dimension" of this set of matrices is small. To get some idea of this dimension, let's count real 
degrees of freedom. By the spectral theorem, almost every matrix in M MxM of rank < 2 can be uniquely expressed as 
A\U\u\ + /I2M2W2 w ' tri ^1 - ^2- Here, {A\,A2) has two degrees of freedom. Next, u\ can be any vector in C M , except 
its norm must be 1. Also, since u\ is only unique up to global phase, we take its first entry to be nonnegative without 
loss of generality. Given the norm and phase constraints, u\ has a total of 2M - 2 real degrees of freedom. Finally, 
U2 has the same norm and phase constraints, but it must also be orthogonal to u\, that is, Re(t<2, u\) = Im(t/2, u\) = 0. 
As such, 112 has 2M - 4 real degrees of freedom. All together, we can expect the set of matrices in question to have 
2 + (2M - 2) + (2M - 4) = 4M - 4 real dimensions. 

If the set S of matrices of rank < 2 formed a subspace of ]HI MxM (it doesn't), then we could expect the null space 
of A to intersect that subspace nontrivially whenever dim null(A) + (4M - 4) > dim(H MxM ) = M 2 . By the rank-nullity 
theorem, this would indicate that injectivity requires 

N > rank(A) = M 2 - dim null(A) > 4M - 4. (5) 

Of course, this logic is not technically valid since S is not a subspace. It is, however, a special kind of set: a real 
projective variety. To see this, let's first show that it is a real algebraic variety, specifically, the set of members of 
jjMxm f or all 3 x 3 minors are zero. Of course, every member of S has this minor property. Next, we show 

that members of S are the only matrices with the property: If the rank of a given matrix is > 3, then it has an M x 3 
submatrix of linearly independent columns, and since the rank of its transpose is also 3, this Mx3 submatrix must 
have 3 linearly independent rows, thereby implicating a full-rank 3x3 submatrix. This variety is said to be projective 
because it is closed under scalar multiplication. If S were a projective variety over an algebraically closed field (it's 
not), then the projective dimension theorem (Theorem 7.2 of 123J) says that S intersects null(A) nontrivially whenever 
the dimensions are large enough: dimnull(A) + dim S > dimH MxM , thereby implying that injectivity requires (0. 
Unfortunately, this theorem is not valid when the field is R; for example, the cone defined by x 2 + y 2 - z 2 =0 in M 3 is 
a projective variety of dimension 2, but its intersection with the 2-dimensional xy-plane is trivial, despite the fact that 
2 + 2>3. 

In the absence of a proof, we pose the natural conjecture: 

The 4M - 4 Conjecture. Consider 0> = Wn) N „ =l £ C M and the mapping ft.: C M /T -> R N defined by (3i{x)){n) := 
\(x, <p n )\ 2 - If M > 2, then the following statements hold: 

(a) IfN < 4M - 4, then ft is not injective. 

(b) IfN > 4M — 4, then ft is injective for generic <I>. 

For the sake of clarity, we now explicitly state what is meant by the word "generic." As indicated above, a real 
algebraic variety is the set of common zeros of a finite set of polynomials with real coefficients. Taking all such 
varieties in R" to be closed sets defines the Zariski topology on M". Viewing O as a member of M. 2MN , then we say a 
generic <S> is any member of some undisclosed nonempty Zariski-open subset of M. 2MN . Considering Zariski-open set 
are either empty or dense with full measure, genericity is a particularly strong property. As such, another way to state 
part (b) of the 4M - 4 conjecture is "If > 4M - 4, then there exists a real algebraic variety V Q M. 2MN such that ft is 
injective for every cD £ V." Note that the work of Balan, Casazza and Edidin 0] already proves this for > 4M - 2. 
Also note that the analogous statement of (b) holds in the real case: Full spark measurement vectors are generic, and 
they satisfy the complement property whenever > 2M - 1 . 

At this point, it is fitting to mention that after we initially formulated this conjecture, Bodmann presented a Vander- 
monde construction of 4M-4 injective intensity measurements at a phase retrieval workshop at the Erwin Schrodinger 
International Institute for Mathematical Physics. The result has since been documented in Jg], and it establishes one 
consequence of the 4M - 4 conjecture: N*{M) < 4M - 4. 

As incremental progress toward solving the 4M - 4 conjecture, we offer the following result: 

Theorem 10. The 4M - 4 Conjecture is true when M — 2. 
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Proof, (a) Since A is a linear map from 4-dimensional real space to A^-dimensional real space, the null space of A is 
necessarily nontrivial by the rank-nullity theorem. Furthermore, every nonzero member of this null space has rank 1 
or 2, and so Lemma [9] gives that M is not injective. 

(b) Consider the following matrix formed by 16 real variables: 



<D(x) 



X\ + 1X2 x 5 + lx 6 

X3 + 1x4 xj + ixg 



Xg + IX10 X12 + IX14 

xn+ixn xi5+i-*i6 



(6) 



If we denote the nth column of O(x) by <p„(x), then we have that J[ is injective precisely when x e M 16 produces a 
basis \if n (x)(f n {x)*} 4 n= l for the space of 2 X 2 self-adjoint operators. Indeed, in this case zz* is uniquely determined by 
Azz* = {(zz*, tfin{x)(p„{x)*)Hs}* =l = ^{z), which in turn determines z up to a global phase factor. Let A(x) be the 4x4 
matrix representation of the super analysis operator, whose nth row gives the coordinates of tp„(x)tp n (x)* in terms of 
some basis for H 2x2 , say 



1 

vi 



1 



i 
-i 



(7) 



and we see that is injective whenever 



Then V — {x : Re det A(x) = Imdet A(x) — 0} is a real algebraic variety in ) 
x € V c . Since V c is Zariski-open, it is either empty or dense with full measure. In fact, V c is not empty, since we may 
take x such that 

r 1 1 1 
1 1 i 



<b(x) = 



as indicated in Theorem 4.1 of Q5|] . Therefore, V c is dense with full measure. □ 

We also have a proof for the M = 3 case, but we first introduce Algorithm l2.2l namely the HMW test for injectivity ; 
we name it after Heinosaari, Mazarella and Wolf, who implicitly introduce this algorithm in their paper 1124 1. 



Algorithm 1 The HMW test for injectivity when M = 3 



{assemble the super analysis operator) 
{if A is injective, then J[ is injective) 



Input: Measurement vectors [<p n } N =i Q C 3 
Output: Whether ^[ is injective 

Define A: H 3x3 -> R N such that AH = {(H, ^*>hs}£Li 
if dimnull(A) = then 

"INJECTIVE" 
else 

Pick H e null(A), H + Q 

if dimnull(A) = 1 and det(JT) + then 

"INJECTIVE" {if A only maps nonsingular matrices to zero, then J[ is injective) 

else 

"NOT INJECTIVE" {in the remaining case, A maps differences of rank-1 matrices to zero) 

end if 
end if 



Theorem 11 (cf. Proposition 6 in 12411 ). When M — 3, the HMW test correctly determines whether J[ is injective. 



Proof. First, if A is injective, then tft{x) = Axx* = Ayy* = J[{y) if and only if xx* = yy*, i.e., y = x mod T. Next, 
suppose A has a 1 -dimensional null space. Then Lemma|9]gives that M is injective if and only if the null space of A 
is spanned by a matrix of full rank. Finally, if the dimension of the null space is 2 or more, then there exist linearly 
independent (nonzero) matrices A and B in this null space. If det (A) = 0, then it must have rank 1 or 2, and so 
Lemma|9]gives that J[ is not injective. Otherwise, consider the map 

/: fn det (A cos f + Bsinf) Vfe[0,7r]. 

Since /(0) = det (A) and f(n) = det(-A) = (-l) 3 det(A) = - det (A), the intermediate value theorem gives that there 
exists to e [0, n] such that /(fo) = 0, i.e., the matrix A cos to + B sin to is singular. Moreover, this matrix is nonzero 
since A and B are linearly independent, and so its rank is either 1 or 2. Lemma|9]then gives that J[ is not injective. 

□ 



As an example, we may run the HMW test on the columns of the following matrix: 



(D = 



2 1 
-1 
1 



1 


-1 



1 

1 -1 -2 
-1 2i i 



(8) 



In this case, the null space of A is 1 -dimensional and spanned by a nonsingular matrix. As such, J[ is injective. We 
will see that the HMW test has a few important applications. First, we use it to prove the AM — 4 Conjecture in the 
M — 3 case: 

Theorem 12. The 4M - 4 Conjecture is true when M — 3. 

Proof, (a) Suppose N < 4M -4 = 8. Then by the rank-nullity theorem, the super analysis operator A: H 3x3 — > M. N 
has a null space of at least 2 dimensions, and so by the HMW test, J[ is not injective. 

(b) Consider a 3 x 8 matrix of real variables <$>(x) similar to ©. Then J{ is injective whenever x e K 48 produces an 
ensemble {f n (x)}^ =1 c C 3 that passes the HMW test. To pass, the rank-nullity theorem says that the null space of the 
super analysis operator had better be 1 -dimensional and spanned by a nonsingular matrix. Let's use an orthonormal 
basis for H 3x3 similar to ^ to find an 8 x 9 matrix representation of the super analysis operator A(x); it is easy to 
check that the entries of this matrix (call it A(x)) are polynomial functions of x. Consider the matrix 



B(x,y) 



y 

AO) 



and let u(x) denote the vector of (1, j)th cofactors of B(x,y). Then (y, u(x)) = det(B(x,y)). This implies that u(x) is in 
the null space of A(x), since each row of A(x) is necessarily orthogonal to u(x). 

We claim that u(x) = if and only if the dimension of the null space of A(x) is 2 or more, that is, the rows of 
A(x) are linearly dependent. First, (<=) is true since the entries of u(x) are signed determinants of 8 x 8 submatrices of 
A{x), which are necessarily zero by the linear dependence of the rows. For (=>), we have that = (y, 0) = (y, u(x)) = 
det(B(x,y)) for all y 6 R 9 . That is, even if y is nonzero and orthogonal to the rows of A(x), the rows of B(x,y) are 
linearly dependent, and so the rows of A(x) must be linearly dependent. This proves our intermediate claim. 

We now use the claim to prove the result. The entries of u(x) are coordinates of a matrix U(x) e H 3x3 in the 
same basis as before. Note that the entries of U (x) are polynomials of x. Furthermore, J{ is injective if and only if 
det U{x) + 0. To see this, observe three cases: 

Case I: U(x) = 0, i.e., u(x) = 0, or equivalently, dim null( A(x)) > 2. By the HMW test, J[ is not injective. 

Case II: The null space is spanned by U (x) + 0, but det U (x) = 0. By the HMW test, J[ is not injective. 

Case III: The null space is spanned by U(x) + 0, and det U(x) + 0. By the HMW test, 3{ is injective. 

Defining the real algebraic variety V = \x : det U(x) = 0} c R 48 , we then have that J[ is injective precisely when 
x e V c . Since V c is Zariski-open, it is either empty or dense with full measure, but it is nonempty since ([8]) passes the 
HMW test. Therefore, V c is dense with full measure. □ 

Recall Wright's conjecture: that there exist unitary matrices U\, U2 and U3 such that (D = [Ui U2 t/3] lends 
injective intensity measurements. Also recall that Wright's conjecture implies N*(M) < 3M - 2. Again, both of these 
were disproved by Heinosaari et al. II24|| using deep results in differential geometry. Alternatively, Theorem [T2l also 
disproves these in the case where M — 3, since A^*(3) = 4(3) - 3 = 8 > 7 = 3(3) - 2. 

Note that the HMW test can be used to test for injectivity in three dimensions regardless of the number of mea- 
surement vectors. As such, it can be used to evaluate ensembles of 3 x 3 unitary matrices for quantum mechanics. 
For example, consider the 3x3 fractional discrete Fourier transform, defined in 11 1 Oil using discrete Hermite-Gaussian 
functions: 
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3 + V3 V3 V3 
V3 ^ ^ 

^ 3^3 3_V3 



3 - V3 - V3 - V3 

_V3 ^ 

_ .jo 3+~yi 3+v? 

V J 2 J 



„am/2 



It can be shown by the HMW test that <D = [/ F 1 ^ 2 F F 3 ^ 2 ] lends injective intensity measurements. This leads to the 
following refinement of Wright's conjecture: 



Conjecture 13. Let F denote the M x M discrete fractional Fourier transform defined in hi (XI . Then for every M > 3, 
O = [/ F l l 2 F F 3 ^ 2 ] lends injective intensity measurements. 
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This conjecture can be viewed as the discrete analog to the work of Jaming Il27ll . in which ensembles of continuous 
fractional Fourier transforms are evaluated for injectivity. 



3. Stability 

3.1. Stability in the worst case 

As far as applications are concerned, the stability of reconstruction is perhaps the most important consideration. 



To date, the only known stability results come from PhaseLift [14], the polarization method |2|], and a very recent 



paper of Eldar and Mendelson IU9II . This last paper focuses on the real case, and analyzes how well subgaussian 
random measurement vectors distinguish signals, thereby lending some notion of stability which is independent of the 
reconstruction algorithm used. In particular, given independent random measurement vectors {(p„}^ =l c R M , Eldar and 
Mendelson evaluated measurement separation by finding a constant C such that 

ll?Kjc)-JI(y)||i>C||x-y||2l|Jc + y||2 Vijel 1 (9) 

where 3i: R M — > is the intensity measurement process defined by (tt(x))(ri) :- \(x, (p n )\ 2 . With this, we can say 
that if J{(x) and J\ky) are close, then x must be close to either +y, and even closer for larger C. By the contrapositive, 
distant signals will not be confused in the measurement domain because J{ does a good job of separating them. 

One interesting feature of ((9) is that increasing the lengths of the measurement vectors {ip„}^ =l will in turn increase 
C, meaning the measurements are better separated. As such, for any given magnitude of noise, one can simply amplify 
the measurement process so as to drown out the noise and ensure stability. However, such amplification could be 
rather expensive, and so this motivates a different notion of stability — one that is invariant to how the measurement 
ensemble is scaled. One approach is to build on intuition from Lemma|9j that is, a super analysis operator is intuitively 
more stable if its null space is distant from all rank-2 operators simultaneously; since this null space is invariant to 
how the measurement vectors are scaled, this is one prospective (and particularly geometric) notion of stability. In this 
section, we will focus on another alternative. Note that d(x,y) := min{||;c - y\\, \\x + y\\] defines a metric on R M /{+!}, 
and consider the following: 

Definition 14. We say f: R M /{ + l) -» R N is C-stable if for every SNR > 0, there exists an estimator g: R N -> 
M M /{±1} such that for every nonzero signal x € R M /{±1) and adversarial noise term z with ||z|| 2 < ||/(x)|| 2 /SNR, the 
relative error in reconstruction satisfies 

d(g(f(x) + z),x) < C 



VSNR 

According to this definition, / is more stable when C is smaller. Also, because of the SNR (signal-to-noise 
ratio) model, / is C-stable if and only if every nonzero multiple of / is also C-stable; for example, if you double 
/, then you can also double z, thereby inclining g to halve its inputs, and none of this changes the relative error in 
reconstruction. As such, this notion of stability offers the invariance to scaling we originally desired. With this, if we 
find a measurement process / which is C-stable with minimal C, at that point, we can take advantage of noise with 
bounded magnitude by amplifying / (and thereby effectively increasing SNR) until the relative error in reconstruction 
is tolerable. 

Now that we have a notion of stability, we provide a sufficient condition: 
Theorem 15. Suppose f is bilipschitz, that is, there exist constants < a < ft < oo such that 

ad(x,y) < \\f(x)-f(y)\\</3d(x,y) Vx,y € R M /{+!}. 
///(0) = 0, then f is ^-stable. 

Proof. Consider the projection function P : M. N — > M. N defined by 

P(y) := argmin ||/ - y|| Vy € R N . 

y' Grange(/) 

In cases where the minimizer is not unique, we will pick one of them to be P(y). For P to be well-defined, we 
claim it suffices forrange(/) to be closed. Indeed, this ensures that a minimizer always exists; since e range(/), any 
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prospective minimizer must be no farther from y than is, meaning we can equivalently minimize over the intersection 
of range(/) and the closed ball of radius ||y|| centered at y; this intersection is compact, and so a minimizer necessarily 
exists. In order to avoid using the axiom of choice, we also want a systematic method of breaking ties when the 
minimizer is not unique, but this can be done using lexicographic ideas provided range(/) is closed. 

We now show that range(/) is, in fact, closed. Pick a convergent sequence {y n }^ =l £ range(/). This sequence is 
necessarily Cauchy, which means the corresponding sequence of inverse images {* n }°li £ M M /{±1) is also Cauchy 
(using the lower Lipschitz bound a > 0). Arbitrarily pick a representative z n e R M for each x„. Then {z„}°lj 
is bounded, and thus has a subsequence that converges to some z e M M . Denote x :- {+z} e R M /{±1). Then 
d(x n ,x) < \\zn - z\\, and so has a subsequence which converges to x. Since is also Cauchy, we therefore 

have x„ — > x. Then the upper Lipschitz bound ft < oo gives that f(x) e range(/) is the limit of {y n }T=v 

Now that we know P is well-defined, we continue. Since a > 0, we know / is injective, and so we can take 
g :- f o P. In fact, a~ l is a Lipschitz bound for / , implying 

d(g(f(x)+z),x) =d(r 1 (P(f(x)+z)),f- 1 (f(x)j) <a- l \\P(f(x)+z)-f(x)\\. (10) 

Furthermore, the triangle inequality and the definition of P together give 

\\P(f(x) +z)- /Mil < \\P(f(x) + z) - (f(x) + Z )|| + IkH < \\f(x) - {f{x) + z)\\ + \\z\\ = 2\\z\\. (11) 

Combining (TTOb and (fTTT i then gives 

d(g(f(x)+z),x) _, Hzll 2a- 1 \\f(x)\\ 2a- 1 \\f(x) - /(0)|| 2/3/a 
rr- 7. < 2a — — < — == ,, ,, = — — ^ — — — < 



IWI IWI VSNR IWI VSNR Ik -0|| " VSNR 

as desired. □ 

Note that the "project-and-invert" estimator we used to demonstrate stability is far from new. For example, if 
the noise were modeled as Gaussian random, then project-and-invert is precisely the maximum likelihood estimator. 
However, stochastic noise models warrant a much deeper analysis, since in this regime, one is often concerned with 
the bias and variance of estimates. As such, we will investigate these issues in the next section. Another example 
of project-and-invert is the Moore-Penrose pseudoinverse of an W x M matrix A of rank M. Using the obvious 
reformulation of C-stable in this linear case, it can be shown that C is the condition number of A, meaning a and {S are 
analogous to the smallest and largest singular values. The extra factor of 2 in the stability constant of Theorem [T5l is 
an artifact of the nonlinear setting: For the sake of illustration, suppose range(/) is the unit circle and f{x) = (-1,0) 
but z = (1 + s, 0); then P{f(x) + z) — (1,0), which is just shy of 2||z|| away from f(x). This sort of behavior is not 
exhibited in the linear case, in which range(/) is a subspace. 

Having established the sufficiency of bilipschitz for stability, we now note that tft is not bilipschitz. In fact, more 
generally, J[ fails to satisfy any Holder condition. To see this, pick some nonzero measurement vector (p„ and scalars 
C > and a > 0. Then 

ll?K(C + 1)^)-^)|| 1 /r./....., , l2 X|2 x2\ 1/2 



d((C+l)<p n ,<p n ) a \\C<p nil 



l —( £ (|<(C + l)<p n , <p n ,)\ 2 - \(<p n ,<p„.)\ 2 f) 
(C+l) 2 -l\W(cp n ) 



c a \\<p n \\ a ■ 

Furthermore, ||^(^„)|| > | (#(¥>„))(«)! = ||^„|| 4 > 0, while {C+ }) a ~~ l diverg es as C — > oo, assuming a < 1; when a > 1, it 



also diverges as C — > 0, but this case is not interesting for infamous reasons 113 Oil . 

All is not lost, however. As we will see, with this notion of stability, it happens to be more convenient to consider 
~\fM, defined entrywise by ( V^(x))(«) = |(x, <p„)\. Considering Theorem [T5l we are chiefly interested in the optimal 
constants < a < (3 < oo for which 

ad(x,y)<\\^(x)- ^(y)\\</3d(x,y) Vx,y e R M /{+!}. (12) 

In particular, Theorem[l5]guarantees more stability when a and ft are closer together; this indicates that when suitably 
scaled, we want to act as a near-isometry, despite being a nonlinear function. The following lemma gives the 
upper Lipschitz constant: 
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Lemma 16. The upper Lipschitz constant for yf^l is — ||0*||2- 
Proof. By the reverse triangle inequality, we have 

||a|-|fe|| <min{|a-fo|, \a + b\} Va,b e 

Thus, for all x,yeR M /{+!}, 



| V^W - V^(y)|| 2 = J] ||<x,^,)| - \(y,<p n )\\ 2 

«=1 

N 2 

< 2j ( min {|<x - y, <p n )\, \(x + y, <p„)\U 
<min{||0*(x-y)|| 2 ,||0*(x+y)|| : 



<\m\ 2 2 (d(x,y)f. (13) 

Furthermore, picking a nonzero x e M. M such that ||0*x|| = ||<I>*||2lMI gives 

||V#(x)- Vfl(0)|| = || VflMII = P**ll = PlilMI = P*|| 2 d(*,0), 

thereby achieving equality in ( fT3l . □ 

The lower Lipschitz bound is much more difficult to determine. Our approach to analyzing this bound is based on 
the following definition: 

Definition 17. We say an M X N matrix O satisfies the cr-strong complement property (cr-SCP) if 

max{^ m i„(^Op,^ min (<5 S c(D^)} > a 2 

for every S £ { 1 , . . . , N}. 

This is a numerical version of the complement property we discussed earlier. It bears some resemblance to other 
matrix properties, namely combinatorial properties regarding the conditioning of submatrices , e.g ., the restricted isom- 
etry property [11|, the Kadison-Singer problem lfl5ll and numerically erasure-robust frames felll We are interested in 
SCP because it is very related to the lower Lipschitz bound in ( TTZb : 

Theorem 18. The lower Lipschitz constant for V^t satisfies 

cr <a < V2(T, 

where cr is the largest scalar for which <J> has the cr-strong complement property. 

Proof. By analogy with the proof of Theorem [3] we start by proving the upper bound. Pick s > and note that <t> is 
not (cr + e)-SCP. Then there exists S Q{1,...,N] such that both /W^sOp < (cr + s) 2 and /tmin^s^c) < (cr + s) 2 . 
This implies that there exist unit (eigen) vectors u,v e R M such that ||<Kk|| < (cr + s)||h|| and ||0* t v|| < (cr + e)||v||. 
Taking x := u + v and y := u - v then gives 

2V 

|| VS(Jt) - V^(y)H 2 = 2 \\(u + v, <p n )\ - \(u - v, Vn )\\ 2 

= ^ \\(u + v, tp„)\ - \(u - v, ip„)\\ 2 + ^ \\(u + v, <p,,)\ - \(u - v, if n )\\ 2 

neS 

<4^K M ,^>| 2 +4 2l<v,^>l 2 

neS neS c 

where the last step follows from the reverse triangle inequality. Next, we apply our assumptions on u and v: 

II VSioo - V^wil 2 < 4(noj M || 2 + iio- c v|| 2 ) 

< 4(cr + e ) 2 (||«|| 2 + ||v|| 2 ) = 8(cr + s) 2 min {||m|| 2 , ||v|| 2 } = 2(<r + e) 2 ( d(x,y)) 2 . 



neS c 
,2 
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Thus, a < V2(cr + s) for all s > 0, and so a < y/2cr. 

Next, to prove the lower bound, take e > and pick x,y e M M /{±1} such that 

(a + s) d(x,y) > || - V^(y)||. 

We will show that <I> is not (<? + e)-SCP. To this end, pick S := {« : sign(x, (p n ) = - sign(y, <^)„)} and define u := x + y 
and v := * - y. Then the definition of S gives 

no* Mil 2 = 2 K*» + (y> ^)\ 2 = 2 l |<x ' ^ n)l ~ l<y ' ^ i}| l 2 ' 

neS neS 

and similarly ||0* c v|| 2 = 2„es c ||<x, ^„)| - |(y, ^„}|| 2 . Adding these together then gives 

JV 

||0; M || 2 + ||(D>|| 2 = ^ |Kx,^„>| - |(y,^„>|| 2 = || Vflfr) - V^(y)|| 2 < (a + e) 2 (d(x,y)) 2 , 

n=l 

implying both ||0* u\\ < (a + e)\\u\\ and ||<X>Lv|| < (a + e)||v||. Therefore, O is not (a + e)-SCP, i.e., cr < a + s for all 
e > 0, which in turn implies the desired lower bound. □ 

Note that all of this analysis specifically treats the real case; indeed, the metric we use would not be appropriate 
in the complex case. However, just like the complement property is necessary for injectivity in the complex case 
(Theorem 13, we suspect that the strong complement property is necessary for stability in the complex case, but we 
have no proof of this. 

As an example of how to apply Theorem[18] pick M and N to both be even and let F = {f„} n ez N be the *xiV matrix 
you get by collecting the first 4f rows of the N x N discrete Fourier transform matrix with entries of unit modulus. 
Next, take <E> = {<p„}„ez N to be the MxN matrix you get by stacking the real and imaginary parts of F and normalizing 
the resulting columns (i.e., multiplying by y/2/M). Then O happens to be a self-localized finite frame due to the rapid 
decay in coherence between columns. To be explicit, first note that 

\{<Pn,<p«)\ 2 = ^KRe/ n> Re/„-> + <Im/«,Im/»'>l 2 

< ^|(<Re/ n ,Re/„,> + <Im/„,Im/„,>) + /(<Im/„,Re/„<> - <Re/„, lmf n ,)f 

= Jp\(fn, fn')\ > 

and furthermore, when n + «', the geometric sum formula gives 



\{fn,fn' )P 



sin 2 (M7r(« - n')/N) 



^ e 2nim(n-ri )/N 
m=0 



sm 2 (n(n - n')/N) sin 2 (n(n - n')/N) ' 



Taking u := <po, v := (p/f/2 an d S :— \n : j <n< j|, we then have 

ll°s"ll 2 „*. „2 V,/ v,2 4 1 4 N/2 AN 



M 2 ^ sm 2 (nn/N) M 2 sin 2 (^/4) M 2 ' 

UK* -I'll 2 ? 

and similarly for ^— _ As such, if N = o(M ), then <t> is cr-SCP only if cr vanishes, meaning phase retrieval with (D 
necessarily lacks the stability guarantee of Theorem[l8] As a rule of thumb, self-localized frames fail to provide stable 
phase retrieval for this very reason; just as we cannot stably distinguish between <pa + ifiN/2 and tpo - (fiN/2 in this case, 
in general, signals consisting of "distant" components bring similar instability. This intuition was first pointed out 
to us by Irene Waldspurger — we simply made it more rigorous with the notion of SCP. This means that stable phase 
retrieval from localized measurements must either use prior information about the signal (e.g., connected support) 
or additional measurements; indeed, this dichotomy has already made its mark on the Fourier-based phase retrieval 
literature lIHIBl. 

We can also apply the strong complement property to show that certain (random) ensembles produce stable mea- 
surements. We will use the following lemma, which is proved in the proof of Lemma 4.1 in 01611 : 
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Lemma 19. Given n > m > 2, draw a real m X n matrix G of independent standard normal entries. Then 

I n\ 1 /n\ n_m+1 

Pr U^iGG*) <-)< Vr>0. 

V t 2 1 Y{n - m + 2) \ t I 

Theorem 20. Draw an M X N matrix <1> with independent standard normal entries, and denote R — Provided 
R > 2, then for every s > 0, <t> has the cr-strong complement property with 

1 N-2M + 2 



with probability > 1 — e~ eM . 

Proof. Fix M and N, and consider the function / : (M — 2, oo) — > (0, oo) defined by 

r(;c -M + 2) 

To simplify our analysis, we will assume that N is even, but the proof can be amended to account for the odd case. 
Applying Lemma [19] we have for every subset S c {1, ... ,N} of size K that Pr(/l min (<I>s<I ) P < a 2 ) < f(K), provided 
K > M, and similarly PrC/WOjcO*,) < a 2 ) < f(N - K), provided N - K > M. We will use this to bound the 
probability that <E> is not cr-SCP. Since /IminC^s^Jc) = whenever \S\ > N - M + 1 and ^ m i n ( t t , s ^J) < -iminC^r^r) 
whenever S c T, then a union bound gives 

Pr(<5 is notcr-SCP) 

= Pr(3S c {l,...,N} s.t. A mia (® s <S>s) < o 2 and /Un(<&s°G>S.) < <x 2 ) 
< Pr(35 c {1,. ..,#}, |S| =tf-M+l, s.t. ^(Os^) < o 2 ) 

+ Pr(3S S {1,. . .,N),M < \S\ < N-M, s.t. /l min (<E) s <D* ) < cr 2 and /i min (<IVO* c ) < <x 2 ) 

(N \ 1 ^ ^ MA 

iV- M+ 1 K - M + l) + 2 Z " *>• < 14 > 

where the last inequality follows in part from the fact that /l m in( < l ) s < l ) J) and /l m in( < l ) s c< l ) J t ) are independent random 
variables, and the factor A is an artifact of double counting partitions. We will further bound each term in (fl4l to get a 
simpler expression. First, ( 2t ) > 2 k for all k and so 

f(N-M + lU m _l M + 3) (^-^ 

< I (o - ^f-2M + 2 . _J_(* -2M + 2\_ 

Next, we will find that g{x) :- f(x)f(N - x) is maximized at x — j. To do this, we first find the critical points of g. 
Since = g'(x) = f'(x)f(N - x) - f(x)f'(N - x), we have 



log/0) 

dy 



fix) f'(N-x) d 

log/00 



f(x) f(N-x) dy 
To analyze this further, we take another derivative: 

1 M- 1 

dy 2 ~ DJ w 2y 2y 2 dy 

It is straightforward to see that 



(15) 

y=N-x 



— \ogf(y) = - + —^-—\ogT(y-M + 2). (16) 



m - 1 i r° rfr -A i rf 2 , w 

^772 = i M+2 7 < § o-m + 2 + .) 2 = df log r( ^ M + 2) < 



2y ' 2y 2 y-M . 
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where the last step uses a series expression for the trigamma function iffi(z) := ;p- logT(z); see Section 6.4 of [Q]]. 
Applying this to ( [ToT l then gives that ^ log f(y) < 0, which in turn implies that ^ log /(y) is strictly decreasing in y. 
Thus, (fTBT l requires x - N - x, and so x = y is the only critical point of g. Furthermore, to see that this is a maximizer, 
notice that 



/"(f)/(fW(f) 2 „_ 2 df'fy) 



'(f) = 2/(f ^ • - ' - = 2/(|) 



/(f) 2 2 dyf(y) 



2/(f) 2 ~log/(y) 



2 



< 0. 



To summarize, we have that f(N - M + 1 ) and f(K)f(N - K) are both at most /( y ) 2 . This leads to the following bound 
on dT4b : 



Pr(<D is not ^-SCP) < - Y H/(f) 2 = 2 jv "7(t ) 2 = 5 — a/?)* 

V > 2^ > \K) JK2J JV2J r(f-M + 2) 21 

Finally, applying the fact that V(k + 1) > e(-)* gives 

2 N ~ l I V^V 



2 / V -/V \ 

Pr((D is notcr-SCP) < — r- creV2- - ^— ^ 



2? 

as claimed. □ 



2S ^( e - e /( s - 2 '2" s/(R " 2) ) (R 2)M+2 < 2 RM {e e 2 R Y M = e~ eM , 



Considering ||0*|| 2 < (1 + e)( V^V + VM) with probability > 1 - 2 e - e( W ' + V3?,2/2 (see Theorem 11.13 of 10), we 
can leverage Theorem [20] to determine the stability of a Gaussian measurement ensemble. Specifically, we have by 
Theorem[l5]along with Lemma[T6]and Theorem[18]that such measurements are C-stable with 

M < 2 J^1 - 2( V^V + VM) ■ V2, • < 2 V2 e (^ W- 2 > (17) 

or cr N-2M + 2 \ R-2 I 



C = — < 



a(R,M) b(R) 



Figure I3TTI illustrates these bounds along with different realizations of 2||4)*||2/cr. This suggests that the redundancy 
of the measurement process is the main factor that determines stability of a random measurement ensemble (and that 
bounded redundancies suffice for stability). Furthermore, the project-and-invert estimator will yield particularly stable 
signal reconstruction, although it is not obvious how to efficiently implement this estimator; this is one advantage 
given by the reconstruction algorithms in iQ. 

3.2. Stability in the average case 

Suppose a random variable Y is drawn according to some unknown member of a parameterized family of proba- 
bility density functions {/(■; ff)}g £ Q. The Fisher information J(9) quantifies how much information about the unknown 
parameter 9 is given by the random variable on average. This is particularly useful in statistical signal processing, 
where a signal measurement is corrupted by random noise, and the original signal is viewed as a parameter of the 
random measurement's unknown probability density function; as such, the Fisher information quantifies how useful 
the noisy measurement is for signal estimation. 

In this section, we will apply the theory of Fisher information to evaluate the stability of J[. To do this, we consider 
a stochastic noise model, that is, given some signal x, we take measurements of the form Y = tft{x) + Z, where the 
entries of Z are independent Gaussian random variables with mean and variance cr 2 . We want to use Y to estimate x 
up to a global phase factor; to simplify the analysis, we will estimate a particular 8(x) = x, specifically (and arbitrarily) 
x divided by the phase of its last nonzero entry. As such, Y is a random vector with probability density function 

f (y - q) = 1 e-wy-nm 2 !^ 1 M y e R n 

J y {2ncr 2 ) N l 2 y 

With this, we can calculate the Fisher information matrix, defined entry wise by 

d , „V d 



(^log/(T;.))(-log/(T;,)) 



(18) 
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Figure 1: The graph on the left depicts log 10 b(R) as a function of R, which is defined in )17t . Modulo e terms, this serves as an upper bound on 
logi (2||<I>*||2/o") with high probability as M — > oo, where d> is an M X RM matrix of independent standard Gaussian entries. Based on Theorem ll5l 
(along with Lemma [T6l and Theorem 1 181 . this provides a stability guarantee for the corresponding measurement process, namely y[M. Since 
log 10 fo(S) exhibits an asymptote at R = 2, this gives no stability guarantee for measurement ensembles of redundancy 2. The next three graphs 
consider the special cases where M = 2, 4, 6, respectively. In each case, the dashed curve depicts the slightly stronger upper bound of log | a(R, M), 
defined in (17) . Also depicted, for each R e {2, 2.5, 3, 3.5, 4}, are 30 realizations of log 10 (2||<I>*||2/(t); we provide apiecewise linear graph connecting 
the sample averages for clarity. Notice that as M increases, log 10 a(R, M) approaches log 10 b(R); this is easily seen by their definitions in (Tjj. More 
interestingly, the random realizations also appear to be approaching log 10 b(R); this is most notable with the realizations corresponding to R = 2. To 
be clear, we use cr as a proxy for a (see Theorem ll8l because a is particularly difficult to obtain; as such, we do not plot realizations of log 10 (2/3/a). 

In particular, we have 

d d I 1 N 2\ 1 N d 

m l0g/( * 9) =80\ ~ 2c7- Z C* - ) = ^ Z (* - W). 

n=i n=i 

and so applying dT~ST > along with the independence of the entries of Z gives 

, if N q o \ N d d 

W) y = ^ Z Z ^ W)) n ^T W))^[Z„Z n ,] = ^ W) ) W ))„. 

n=l n' = l J n=l J 

It remains to take partial derivatives of ^[(0), but this calculation depends on whether 9 is real or complex. 
In the real case, we have 

d d I M \ 2 I M 

de ^ {0)) " = de\ Z d "'^ (m ^) = 2 ( Z 8m<Pn(m)]<p„(i). 

Thus, if we take ^¥(6) to be the M x N matrix whose «th column is (6, <p„)<p„, then the Fisher information matrix can 
be expressed as J{9) = X^{6yV{6)* . Interestingly, Theorem [3] implies that J(9) is necessarily positive definite when 
J{ is injective. To see this, suppose there exists 9 e O such that J(6) has a nontrivial null space. Then {(8, (p n )<Pn} N -i 
does not span K M , and so S — {n : (8, <p n ) = 0} breaks the complement property. As the following result shows, when 
J[ is injective, the conditioning of J(8) lends some insight into stability: 

Theorem 21. For x e R M , let Y = Jiix) + Z denote noisy intensity measurements with Z having independent N(0, cr 2 ) 
entries. Furthermore, define the parameter 8 to be x divided by the sign of its last nonzero entry; let Q. Q R M denote 
all such 8. Then for any unbiased estimator 8(Y) of 8 in Q with a finite M X M covariance matrix C(8), we have 
C{8) — J(8)~ l is positive semidefinite whenever 8 e int(fi). 

This result was first given by Balan (see Theorem 4. 1 in Note that the requirement that 8 be in the interior of 
Q can be weakened to 8 + by recognizing that our choice for 8 (dividing by the sign of the last nonzero entry) was 
arbitrary. To interpret this theorem, note that 

Tr[C(§)] - Tr[E[(r)(F) - 8){8{Y) - 8) T ]] 

= E[Tr[(r)(F) - 8){8{Y) - 8) T ]] = E[Tr[(f)(F) - 8) T (8(Y) - 8)]] = E\\8(Y) - 8\\ 2 , 
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and so Theorem |2TI and the linearity of the trace together give E||8(F) - 9\\ 2 = Tt[C{9)] > Tr[J(9y 1 ]. In the previous 
section, Definition [14] provided a notion of worst-case stability based on the existence of an estimator with small 
error. By analogy, Theorem |2T| demonstrates a converse of sorts: that no unbiased estimator will have mean squared 
error smaller than Tr[J(ff)~ 1 ]. As such, a stable measurement ensemble might minimize sup flen Ti[J(9)~ l ], although 
this is a particularly cumbersome objective function to work with. More interestingly, Theorem |2T|provides another 
numerical strengthening of the complement property (analogous to the strong complement property of the previous 
section). Unfortunately, we cannot make a more rigorous comparison between the worst- and average-case analyses 
of stability; indeed, our worst-case analysis exploited the fact that yf&i is bilipschitz (which J{ is not), and as we shall 
see, the average-case analysis depends on J{ being differentiable (which ~\fM is not). 

To calculate the information matrix in the complex case, we first express our parameter vector in real coordinates: 
9 - {9\ + Wm+i , 02 + i#M+2, ■ • ■ , &m + i#2mX that is, we view 9 as a 2M-dimensional real vector by concatenating its real 
and imaginary parts. Next, for any arbitrary function g: R 2M — > C, the product rule gives 



Since we care about partial derivatives of tft{9), we take g(9) = {9, <p„) = 2 m=1 (6' m + i9 M+m )(p„(m), and so 

3 - / if ' - M om 

W m ~\-Wnii-W *i>M. (20) 

Combining ( fT9l and ( f20l > then gives the following expression for the Fisher information matrix: Take to be 
the 2M x N matrix whose nth column is formed by stacking the real and imaginary parts of (9, ip n )(p„; then J(ff) = 

Lemma 22. Take J (6) to be the (2M — 1) X (2M — 1) matrix that comes from removing the last row and column of 
J(B). If 31 is injective, then J(9) is positive definite for every 9 e int(Q). 

Proof. First, we note that J(ff) = -^ v f , (0) v P(0)* is necessarily positive semidefinite, and so 

inf x T J(6)x = inf [x; 0] T J(e)[x; 0] > inf y T J(9)y > 0. 
IWI=l IWH llv||=i 

As such, it suffices to show that J(8) is invertible. 

To this end, take any vector x in the null space of J(9). Then defining y := [x; 0] e K 2 ^, we have that J(9)y is zero 
in all but (possibly) the 2Mth entry. As such, = (y, J(8)y) = \\^ x i'(9)*y\\ 2 , meaning y is orthogonal to the columns of 
x ¥{9). Since is injective, Theorem|4]then gives that y = ai9 for some or e R. But since 9 € int(O), we have 9m > 0, 
and so the 2Mth entry of \9 is necessarily nonzero. This means a — 0, and so y (and thus x) is trivial. □ 

Theorem 23. For x e C M , let Y = J[{x) + Z denote noisy intensity measurements with Z having independent N(0, cr 2 ) 
entries. Furthermore, define the parameter 9 to be x divided by the phase of its last nonzero entry, and view 9 as a 
vector in R 2M by concatenating its real and imaginary parts; let Q C R 2M denote all such 9. Then for any unbiased 
estimator 9(Y) of 9 in Q with a finite 2M X 2M covariance matrix C(9), the last row and column ofC{9) are both zero, 
and the remaining (2M - 1) X (2M - 1) submatrix C(9) has the property that C(9) - J(9)~ l is positive semidefinite 
whenever 9 € int(il). 

Proof. We start by following the usual proof of the vector parameter Cramer-Rao lower bound (see for example 
Appendix 3B of K^H ). Note that for any i, j e {1, . . . , 2M], 

my))j-0j) 77 f(y\6)dy= (9(y))j dy - 0j — dy 

Je" o8i J K « oVi J r n d8i 

o9i J r n 09i J R « 

where the second inequality is by differentiation under the integral sign (see Lemma l24l for details; here, we use the 
fact that 9 has a finite covariance matrix so that 9j has a finite second moment). Next, we use the facts that 9 is unbiased 
and /(■; 9) is a probability density function (regardless of 9) to get 

8\ogf(y-9) ^ ^ _ d9j _ / 1 if i = j 

if i* j 



f 



,<91og f(y;0) 89 j { 

((000) » - 0j) — „ f(y, 8)dy — -t— — \ 



17 



Thus, letting log f(y; 0) denote the column vector whose z'th entry 

is ^JMl, we have 

1= f 0(y)-e)(Velogf(y-e)) r f(y;0)dy. 
Jr n 



Equivalently, we have that for all column vectors a, b e 



b2M 



a J b= f a T (0(y)-0)(V g logf(y;0)) T bf(y;0)dy. 

Next, we apply the Cauchy-Schwarz inequality in /-weighted I? space to get 

(a T bf = ( f a T (0(y) - 6)(V e log/0; 6)) T b f(y; 0)dy\ 

<( f a T {0(y)-0){0(y)-0) T af{y-0)dy\ f b T (V e log f(y; 0))(V e log f(y; 0)) T b f(y; 0)dy) 
= (a T C(0)a)(Z7 T /(6»)/7), 

where the last step follows from pulling vectors out of integrals. At this point, we take b :- [J(ff)~ l a; 0], where a is 
the first 2M - 1 entries of a. Then 

(a T 7(6») _1 fl) 2 = (a T bf < (a T C(0)a)(b T J(e)b) = (a T C(0)a)(a T 7(0y l a). (21) 

At this point, we note that since the last (complex) entry of € Q is necessarily positive, then as a 2M-dimensional 
real vector, the last entry is necessarily zero, and furthermore every unbiased estimator in Q. will also vanish in the 
last entry. It follows that the last row and column of C{0) are both zero. Furthermore, since J(0)~ l is positive by 
Lemmal22l division in ( |2"TT i gives 

{a T J{0)- x a) < (a T C(0)a) = (a T C(0)a), 
from which the result follows. □ 

Appendix 

Here, we verify that we can differentiate under the integral sign in the proof of Theorem [23] 
Lemma 24. Consider the probabdity density function defined by 

/Cy; o) = 1 e-uy-^n 2 /^ 1 \/ y e R N . 

JKy ' (2no- 2 ) N / 2 y 



Then for every function g: WL N — > K with finite second moment 

2 f(y; 0)dy < oo V# e Q., 

J 

we can differentiate under the integral sign: 



f giyfj 



|r f g(y)f(y;0)dy= f g(y)-^f(y;0)dy. 



Proof. First, we adapt the proof of Lemma 5.14 in 02911 to show that it suffices to find a function b(y; 0) with finite 
second moment such that, for some s > 0, 



f(y-0 + z6i)-f(y-0) 



zf(y;0) 



<b(y;0) Vyem. N ,0€£l,\z\<e,zi=O (22) 



where S, denotes the ;th identity basis element in M 2M . Indeed, by applying the Cauchy-Schwarz inequality over 
/-weighted L 2 space, we have 



f \g(y)\b(y, 0)f(y; 0)dy < ( f g(y) 2 f(y; 0)dy) l ' 2 ( f b(y; 0) 2 f(y; 0)dy\' 2 < oo 
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and so the dominated convergence theorem gives 

f 8(y)p(y;e)dy= f toU ^M W,^ 
Jb" oft Jk-v^ov z/(y;0) / 

= limi( f gfy)f(y,9 + zSi)dy- f g(y)f(y;9)dy 

In pursuit of such a function fc(y; 0), we first use the triangle and Cauchy-Schwarz inequalities to get 

f(y; 9 + zdj) - f(y; 9) _ 1_| i (iiy-jKe+^iP-iiy-^ip) _ J 

z/(y;0) kr " 1 

. J_| - 7 i T (||^(8+ztfi)lP-|W)ll 2 -2(y,^l(fl+ztfi)-^(9)>) _ A <y,,?l(0+z,5 i )-.7l(0)) -4 <y„?l(0+z,5 i )-.7l(6O> _ -, 
ill + e°" 1 

< j_/ ^■(y,51(fl+rf,)-^(fl)>| -^(iW+rf.OlP-IW)!! 2 ) _ 1 1 . I e jt<yJ«fi+zSt)-2W) _ i\\ 

- \ z \\ ' i ii i; 

< j_| e ^IMIIW+zai)-^(«)ll| e -^i(lW+zai)lP-ll^i(«)lP) - lj + | e ^IMIIM«+z<»-.3 ! <(<?)ll _ j|j 

Denote c(z; 0) := ^11^(0 + z8{) - Ji(9)\\. Since (e" - l)/f < se s ' whenever 5, f > 0, we then have 

k^W-H = £fc0) e «'"-l cfcg) .. .. rf ^|| Y || 
lz| Izl c(z;0) " |z| Imi 

Also by l'Hospital's rule, there exist continuous functions C\ and C2 on the real line such that 

Clfc 0) = £M, c 2 (z; 0) = I| e -^(ll^)lP-IW)lP) _ J v ^ o. 
kl kl 1 1 



(23) 



Thus, continuing d23l gives 



f(y,e + zSi)-f(y;0) 



:(c 1 fce)||y|| + C 2 (z;0))e 



,cfe;fl)llyll 



z/Cy;0) 

Now for a fixed e, take C/(0) := sup|.| <£ C/(z; 6) and c(#) := sup|.| <£ c(z; 6), and define 

6(y;fl):=(Ci(fl)||y|| + C 2 (e))« e<fl)lwl . 

Since Cj{6) and c(0) are suprema of continuous functions over a bounded set, these are necessarily finite for all 8 e Q. 
As such, our choice for b satisfies (l22l i. It remains to verify that b has a finite second moment. To this end, let B{R{9)) 
denote the ball of radius R(8) centered at the origin (we will specify R(9) later). Then 

f b(y;9) 2 f(y;e)dy= f b(y;8) 2 f(y;9)dy + f b(y;9) 2 f(y;9)dy 
Jm N Jb(R(B)) Jr n \b(R(8)) 

< (C 1 (9)R(9) + C2{9)fe 2c(0,m 

+ 7T J W f (dMIMI+CaCT) 2 ^^'-^!^!! 2 ^. (24) 

(2^cr / ) iv / z Jw\lHR(ff)) v y 

From here, we note that whenever ||y|| > 2||^i(#)|| + 8cr 2 c(0), we have 

||y - ^)ll 2 > IMI 2 - 2||y|||l?l(e)|| + W)|| 2 

> (2\V?W\\ + 8cr 2 c(9))\\y\\ - 2||y||||^(0)|| + \W(9)f 

> 8cr 2 c(9)\\y\\. 
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Rearranging then gives 2c(0)||y|| < -Az\\y — &l(ff)\\ 2 . Also let h(6) denote the larger root of the polynomial 

p(x; 0) := 2C l (0) 2 (x 2 - 2WQ\\x + OT)II 2 ) - {CMx + C 2 (0)f, 

and take h(ff) : = when the roots of p(x; 8) are not real. (Here, we are assuming that C\ > 0, but the proof that (124-b is 
finite when C\ = quickly follows from the C\ > case.) Then (Ci(6)||y|| + C 2 {0)f < 2C l (ff) 2 \\y - J{(6)\\ 2 whenever 
||y|| > h(ff), since by the Cauchy-Schwarz inequality, 

2C l {ef\\y -ft{0)\\ 2 - (cmu\ + CiiO)) 2 > P {\\y\\;e) > 0, 

where the last step follows from the fact that p(x; 8) is concave up. Now we continue by taking R(0) :- max{2\\M(6)\\ + 
8cr 2 c(6»),/i(6>)}: 



m. N \B(R(8)) 



< I 2Cm 2 \\y-^(e)\\ 2 e'^ lb '^ m 'dy 

)M. N \B(R(0)) 



f 

<(2^(V2 ( r) 2 f /2 .2C l (0) 2 f |W| 2 -L^ e -IMf/2(V2^ 



where the last step comes from integrating over all of and changing variables y - Ji{9) i-> x. This last integral 
calculates the expected squared length of a vector in with independent N{0,2cr 2 ) entries, which is 2Ncr 2 . Thus, 
substituting into (|24| | gives that b has a finite second moment. □ 
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